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OCULOMETER FOCUS 


AND 

MIRROR CONTROL 


by 


Warren J. Guy 


1. Introduction 

Since 1970 the Flight Dynamics and Control Division at 
the National Aeronautics and Space Administrations' Langley 
Research Center, Hcimpton, Va., has been engaged in a research 
program employing a remote sensing oculometer. The purpose 
of this program has been to gather and analyze dynamic data 
collected about pilot eye behavior. Ultimately it is hoped 
that this research will lead to strategies for optimal air- 
craft instrument panel design and better pilot training 
(1,2,3) . 



The heart of this research is built around the oculome- 
ter, a nonintrusive eye tracking instrument. The unit 
employs a safe infrared (IR) beam which is reflected off 
the retina and cornea to produce an image picked up by an 
IR sensitive video system. The picture is digitized and 
pertinent information processed by a mini-computer (4) . 

The "look point" is the primary output of the system; 
however, other functions must also be performed by the 
computer. 

As the subject's eye and/or head moves, it is necessary 
to maintain the eye image nearly centered in the TV field. 

This is accomplished v;ith two mirrors orthogonally oriented 
which direct the IR beam to the subject and receive the re- 
flected eye image. The mirrors, driven by galvanometer 
motors, are controlled by the minicomputer. The computer 
generates a control signal based on the motion of the eye as 
detected by the video signal. Often, due to sudden voluntary 
motion or involuntary motion caused by turbulence, the eye 
image is lost. At this point the tracking system must go into 
a lengthy and not always successful searching routine to re- 
capture the eye image. During this search period all the data 
is lost, and depending upon conditions, well over 10% of the 
experiment time could be taken by searching. 

In the normal computational process, the computer has 
l/60th second between fields to find the look point and out- 
put the necessary control signals to the system peripheral 
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equipment like the mirrors. The program requires a great 
deal of time (usually greater than l/ 60 th second) to per- 
form its tasks. Due to the structure of the software, this 
means that alternate fields are lost. When this occurs, it 
is possible to lose track and thus be forced into a search 
mode . 

The system as it is currently configured requires the 
constant attention of a highly skilled operator. It is his 
function to accelerate the search process, keep the optical 
system focused, determine the record linearization data for 
each experiment and maintain the equipment. Thus, work has 
been undertaken to speed up the computational process, 
miniaturize the oculometer system, unburden the main com- 
puter and reduce the operator skill level and intensity. 

To this end, this report discusses methods to decrease the 
required operator attention through automatic focusing and 
tracking. An important by-product of this effort is that 
the subject's range is constantly updated; thus providing 
the computer with data so that a more accurate look point 
can be calculated. 
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2. FOCUS C-ONTROL 

The distance to the subject from the reference plane 
on which the look point is desired is determined in the 
IJOVA computer by processing the voltage off the focus com- 
mand (FC) potentiometer. This pot is manually adjusted by 
the operator as the subject moves his head position. While 
this chore is not overly burdensome, inaccurate focusing 
can lead to a fuzzy image, the possibility of losing track, 
and incorrect look point calculation. 

The inaccurate look point can be caused by improper 
focus and the subsequent computational error produced in 
the corneal high light - pupil relationship. It can also 
be induced by an inaccurate measurement range; this latter 
type error will be considered. Figure 1 shows a y look 
point error. Ay. As can be seen from the figure, if the 
real range is R and there is a negative error, AR, the 
look point will be calculated higher by the amount 

Ay = AR sin 9 

For a nominal range error of 2 inches and 0 = 10°, the 
look point error could be 0.35 inches. 
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FIGURE 1. Range error induced look point 
offset . 
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Thus an automatic focusing mechanism for the oculometer 
will reduce these errors because more accurate range data 
will be available to the computer. Also, a sharp image will 
be maintained at all times. 

To accomplish the automatic focus control, a simple po- 
sition feedback control system is used, figure 2. An ultra- 
sonic range detector and microprocessor develop the focus 
command. This signal (along with a potentiometer position 
feedback voltage) drives a standard servomechanism error 
amplifier. A power amplifier controls the small dc servo- 
motor. 

In the next section a systems overview of both the 
hardware and the software will be given. Then the focus 
table development will be described. Finally a detailed 
description of the electronics and microprocessor program 
will be presented. 

2.1 SYSTEM OVERVIEW 

HARDWARE : Figure 3. The range detector employs a 

commercially available ultrasonic ranging system (5) , which 
consists of a capacitive microphone and a transceiver board. 
The unit must be supplied with a 6V, 3A (minimum) power supply 
and an external circuit to control the repetition rate of 
the transmit/receive cycle. The unit produces two output 
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Automatic Focus System basic 
structure . 
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FIGURE 3. Oculometer automatic focus system block diagram 













pulses on separate lines, one when the transmitter is turned 
on and the other when an echo is received. The rate control 
must allow sufficient time for the ultrasonic pulse to travel 
to and return from the target. The specifications limit 
the time between transmit pulses to 40 msec.; the prototype 
automatic focus system is designed for a 100 msec, cycle time. 

An interface board buffers the ranging system and 
control circuits. The transmit and echo pulses are next 
passed through the pulse shaper where they are cleaned up 
and gated to prevent false echos which would interrupt the 
microprocessor. Using an on-board timer, the microcomputer 
measures the time to the target, filters the data, generates 
a range count for display purposes and outputs a digital 
focus command (FC) . The digital command is then converted 
to analog form. 

The error amplifier can be switched between a manual 
and automatic focus control signal. In the manual mode, a 
simple potentiometer changes the focus . This is the way 
focus is currently adjusted. The FC command (manual or 
automatic) is compared with the lens position via a feedback 
potentiometer and a signal developed to drive a power am- 
plifier. The final element in the system is the mechanical 
parts; motor, gears, and load. 

When the system is out of focus, an indicator light is 
turned on. 
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SOFTWARE : Figure 4 shows the flow chart for the micro-, 

computer program. A manual reset starts the program by clear- 
ing the appropriate working registers. The on-board timer is 
then cleared (START) and the subroutines SHOW and DISPLAY 
called. These two subroutines decode the binary range count 
(the round-trip time to the target) to a 3 digit BCD Code which 
is cycled through hundreds, tens, and units; the display is held 
on until the transmit pulse is sent- At this time the timer is 
activated (TIME) and the interrupt enabled. While waiting for 
the echo (typically 4 to 6 msec) , the previous binary range 
count is converted to a decimal format by DISPLAY. The program 
continues its wait by returning to the SHOW and DISPLAY sub- 
routines . 

Upon the arrival of the echo, the microcomputer is in - 
terrupted (STOP) , the timer stopped and checked. If the count 
is too large (greater than SO^^q) the target is out of range and 
the maximum distance (SO^^q) is substituted for the range count. 

The range count is now filtered by a simple digital filter 
algorithm (FILTER) ; 

OUT (I) = OUT(I-l) + COUNT (I) - OUT(I-l) 

4 

where 

COUNT (I) = the range count (typically 30^^ - 90^^) 

COUNT (I) = the new filter output 

OUT (I-l) - the previous filter output 
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FIGURE 4. Oculometer automatic focus flowchart 
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Finally OUT (I) is used to look up in a focus table 
the actual binary focus command (FC) . This information 
is next latched into PORT 1. The program then cycles back 
to START where the whole process is repeated. 

If the timer should overflow due to a malfunction or 
the lack of a target, the system ignores the range data 


and returns to START. 



2.2 FOCUS COMMAND TABLE 

OPTICAL SYSTEM : The optical system to be controlled 

is shown in figure 5. Here the ground glass plate, built 
into the demonstration model, would be the active surface 
of the TV camera in the oculometer. Lens F2 is mounted 
in a movable lens carriage. It is the distance L2 that 
will be controlled by the servomechanism. FI is a fixed 
lens located a distance Ll from the plate. The subject is 
at a range R from the optical system. 

The equation governing the relationship between the 
system variables is stated below: 

F1*R = (R - F1)*(L1 - L2 + (F2*L2/(F2 + L2) ) ) 
where FI = focal length of lens 1 (nominally 95mm) 

F2 = focal length of lens 2 (nominally -29mm) 

R = range to subject (nominally 600 to 1200mm) 

Ll = fixed distance - lens 1 to plate (nominally 160mm) 

L2 = variable distance - lens 2 to plate (nominally 60mm) 
Rearranging the equation to find L2 in terms of range R gives 
the nonlinear relationship: 

L2^ + (F1*/(R-F1)^L1)*L2 +(F1*R/(R-F1) - Ll)*F2 = 0 

Because the computation of L2, with range as a variable, 
would require a fairly complex effort for the microprocessor 
and a large block of time, it was decided to use a look-up 
table to relate the tv/o. 
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FIGURE 5. Optical system for demon 
stration unit. 
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RANGE-TIME RELATIONSHIP ; The range measurement used 
in the focus command table comes from the microprocessor's 
on-board timer. It actually measures the time between the 
start of the transmitter and the received echo. For the 
system in question the timer counts pulses at the rate of 
one every 80 usee. (6) from an internal clock. For sound 
traveling at 13548 inches/sec., this gives a theoretical 
range/count relationship of; 

RANGE (inches) = 0.54 * COUNT 

Actual measurement of the system produced a slightly 
modified equation; 

RANGE (inches) =-0.36 + 0.55 * COUNT 
The offset error (-0.36 inches) may be due to the uncertainties 
in the start of the ultrasonic transmission and the timer or 
from inaccurate range measurements. 

Figure 6 shows this experimentally obtained relationship. 

FOCUS TABLE ; Refer to figure 7. To obtain the final 
range/focus command (R/FC) table, a theoretical curve was 
first derived. It is based on a measured maximum of + 7 
volts output from the feedback potentiometer. The resulting 
curve is given in figure 7. This curve is very sensitive 
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FIGURE 7 

Voltage for focus command (ElAC output 
manual, and theoretical) vs. Range. 




ta small errors in LI, FI, and F2. Thus, when the theo-' 
retical focus table was loaded into the EPROM (8748) , it 
was found that a good focus was not achieved over the entire 
range of interest. 

A qualitative measurement was then made by focusing 
the optical system by eye and measuring the feedback 
potentiometer output. After repeating this experiment 
several times, a band of acceptable focus points for each 
range was obtained. This is indicated by the two solid 
curves in figure 7. 

Values within these curves v;ere then chosen for the 
focus table, converted to the appropriate DAC input and 
loaded into the EPROM. After several minor adjustments, 
this method produced a focus command which gave good results 
over the entire range. The final points entered in the 
focus table are the dark circles in figure 7. 

2.3 FOCUS TABLE ADJUSTMENTS 

The focus commands stored in the focus table (page 03 
of the 8748 EPROM) , are dependent on the particular mechani- 
cal relationship between the ultrasonic microphone, which 
detects the range, and the optical system, which focuses 
on the subject. To allow for differences in this relation- 
ship, five possible adjustments exist. 
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1. For each situation reprogram the 8748. This 
would entail a lengthy initial set-up procedure 
in which the focus voltages are measured, con- 
verted to a digital command and "burned" into 
the EPROM. Once done it would not have to be 
repeated for a particular installation. 

2. Mechanically adjust the relationship (fine tune) 
between the microphone and the lens for the best 
focus over the ranges anticipated. At extremes, 
there will be focus errors. 

3. Adjust the DAC offset potentiometer (to be dis- 
cussed when the electronics are described) . This 
shifts the focus curve, figure 7, up and down. 
Again this adjustment may be satisfactory over 
limited ranges, but will not be good at the 
extremes . 

4. Adjust the focus table entry point by adding or 
subtracting a fixed amount; i.e., increment/ 
decrement the range count. This moves the focus 
curve left or right and at extreme ranges again 
may result in excessive errors. A combination 
of 3. or 4 may give better results. Option 3 is 
a simple screwdriver adjustment. Option 4 re- 
quires only a simple program change, but will 
necessitate "burning" a new program into the 
EPROM for each adjustment. Like 1, once done 

it need not be repeated. 
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5. Store the focus table in RAM. The table 
would be entered at start-up for each run. 

It would therefore require a one-time 
initialization procedure. Also it would 
mean a significant design change of the 
electronics to allow proper interfacing 
with and data transfer from the mainframe 
computer . 

Procedure 5 gives the greatest flexibility. Number 1 
is the next best permanent option. 3 and 4 combined require 
the same effort as 1. All things considered, procedure 2 
appears to be the simplest method to adjust the system for 
different experimental set-ups. This method was used during 
the design stages. 

2.4 ELECTRONIC CIRCUIT 

The front end of the automatic focus control unit con- 
sists of a commercial ranging system, figure S. This system 
emits a 60, 57, 53, and 50 kHz sequential ultrasonic signal 
from a capacitive microphone. The transceiver board, 
powered by a user supplied 6V, 3A source, provides both 
the "start of transmit" signal and the "echo received" sig- 
nal. Details of the operation can be found in reference 5. 

The transceiver is controlled by a multivibrator built 
from a 74C14 Schmidt inverter and the 2N4401/2N2907 buffer. 
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FIGURE 8. Interface circuit for Polaroid Ultra- 
sonic Range Pleasuring System. From 
Polaroid Handbook. 



When the INITIATE TRANSMIT PULSE goes high, the transceiver 
board is activated and after a brief period (less than 1 
msec.) the ultrasonic signal is started and maintained for 
about 1 msec. This action is detected in pin 16, buff erred 
by the 2N4401, and sent to the microprocessor. 

The echo signal, when detected, causes a high pulse 
at pin 15. This signal is also bufferred by a 2N4401 and 
then used to drive the microprocessor. 

Figure 9 shows the digital portion of the control board. 
The start and echo signals drive separate 74123 's, dual 
monostables. The input signals initiate a 1 millisecond 
pulse from each package's first monostable; which, on its 
rising edge, activates the respective second monostable. 

A 10 usee, pulse is then available on pins 5 or 12. Pin 5 
is a positive pulse (Q) and drives the microprocessor input 
T0 (used to start the on-board times) . Pin 12 is a Q pulse 
which is used to interrupt, INT, the microprocessor and 
stop the timer. The initial 1 msec monostable is used to 
block false start and echo signals that may appear on the 
lines due to echos from multiple targets or other noise 
sources. 

The only manual control of the microporcessor is a re- 
set button which, among other things, sets the program 
counter to 00^. A 6 MH^ crystal controls the instruction 
cycle time and the on-board times. Two of the three avail- 
able ports on the 8748 are used; one (Port 2) is tied to a 











display which will not be necessary in the final oculometer 
design, and the other (Port 1) outputs the digital focus 
command (FC) . 

FC is converted to analog form by an 8 bit DAC 1408. 

This DAC output is a 0 to -2 mA current which through a 
741 op-amp is converted to an appropriate voltage as de- 
termined by the feedback resistor. The lOK potentiometer 
serves to provide bipolar operation from the DAC by biasing 
the op-amo so that with a 80„ input, the op-amp output is 
0 V. This gives an offset binary code operation. 

The analog signal (FC) is next used as a command signal 
to a standard position feedback circuit, figure 10. If the 
operator desires, the FC signal can be derived from a manually 
controlled potentiometer. In either case this signal is com- 
pared to the feedback signal generated by the potentiometer 
connected to the motor shaft. When there is an error signal, 
it is amplified by the two 741' s and used to drive a comple- 
mentary pair (NPN-2222 and PNP-2N2907) . This pair in turn 
controls the current to the servomotor. Feedback from the 
top of the motor to the second 741 serves to reduce the dead 
zone created by the complementary transistors: 

An LED indicator is also provided to inform the operator 
when the system is not responding to the FC command (manual 
or automatic). Two LM311's (comparators) set limits so that 
an error greater than + 0.1 volts will turn on the LED. 






FIGURE 10. Electronic controller and focus 
error indicator circuits. 




-f-S 


- 25 - 



The motor, gears, lens carriage, and mount were provided 
by the Flight Dynamics and Control Division, Langley Research 
Center, Hampton, VA. 

The final circuit, figure 11, consists of a 74C48, BCD to 
7 segment driver, three 7 segment displays and three 2N2222's 
used as switches. Port 2's lower 4 bits provide the BCD code 
while bits 4, 5, and 6 respectively turn on the units, tens, 
and hundreds display digits. 

The final figure of this section, figure 12, shows the 
cable connections for the power supply and servo unit. 

2.5 SOFTWARE 

The heart of the automatic focus control unit is 8747 
microcomputer on a chip. This unit has a IK EPROM program 
memory, 64 byte data RAt4, one on-board timer, and 27 pin 
I/O arranged as three 8 bit ports and three test pins. 

In establishing the memory map, figure 13, the RAM is 
divided into two memory banks, RB0 and RBI. RB0 is used 
to store the range count (COUNT) from the timer, calculate 
the digitally filtered output (OUT) , and store the previous 
output. RBl is used to convert the binary to decimal and 
then to BCD and finally output the 3 digit display control 
signal . 

The IK EPROM contains all the permanent software (8). In 
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PAGE 3 PAGE 0 


MENDRY MAP 




PROGRAM MEMORY REGISTERS 


OOH 

lOH 

20H 

30H 

80H 

AOH 

BOH 

320H 

360H 


i VECTORS FOR 
i RESET, INTERRUPT 
j TIMER OVERFLOW 

I 

i 

i INITAL 


I START/TIME 

I 

j STOP/FILTER . 


DISPLAY 


STOW 


DELAY 


lllllllllllllh 


FOCUS TABLE 



0 

1 

2 

3 

4 

5 

6 
7 


18 

19 

lA 

IB 

1C 

ID 

IE 

IF 


TEMPORARY INDEX 

COUNT (INTEGER) 
COUNT (DECIMAL) 
OUT(I-l) (INTEGER) 
OUT(I-l) (DECIMAL) 
WORKING REGISTER 
WORKING REGISTER 



REMAINDER STORAGE 


TENS SUBTRACTOR 
HUNDREDS SUBTRACTOR 
UNITS OUTPUT 
TENS OUTPUT 
HUNDREDS OUTPUT 



FIGURE 13. 

Oculometer automatic focus 
memory map . 
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page 00 is the main program. Figure 13 shows where the 
subroutines are located. This map can be compared with 
the flow chart in figure 4. Page 03 contains the focus 
table which is used to generate the proper focus command, 
given the range count (OUT(l)). 

The digital filter uses a simple algorithm 

OUT (I) = (OUT(I-l) + 0.25 (COUNT (I) - OUT(I-l)) 

The 0.25 multiplier was used because of the ease with which 
it can be implemented; i.e., double shift right. It was de- 
termined after experimentally trying other 2 ” factors. 

In the focus table, ranges from about 19” to 50" are 
allowed. Closer than 19" the lens carriage will have reached 
its limit. Ranges greater than 50" produce a count greater 
than 90 and are thus rejected. In this case the lens carriage 
is near its other limit and will remain so until the target 
range is less than 50". 

The remaining pages of this section contain the program 
stored in the 8748. The format gives the line number in 
column 1, the memory address in column 2, either the hex 
machine code or data in column 3, column 4 is a label, the 
mnomic is in column 5 and lastly in column 6 are comments. 

The details of the program are explained by the contents. 
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PAGE 1 HEWLETT-PACKARD 32201A.7.10 EDIT/3000 TUf, JUN 1, 1982, 

1 


RANGE/FOCUS PROGRAM FOR OCULOMETER 
AUTOMATIC FOCUS USING INTEL 8748 
1-18-82, UJG 

FOR MAT-ADDRESS/DATA OR INSTRUCTION/LADEL/HNLMONIC/COMMENT 


•XX-X-X-X-X..X-.XW.X- INITIALIZE/START/TIME x-xx-x-xx-xx-.x-x- 

LOCATIONS 00-08 USED FOR RESET, INTERRUPT, AND TIMER OVER- 


FLOW VECTORS. 


00 

04 

RESET 

JMP 

01 

10 


INITIALIZE 

02 

00 



03 

04 

INTER 

JMP 

04 

30 


STOP 

05 

00 



o.s 

0 0 



07 

04 

TOVER 

JMP 

03 

20 


START 


10 

27 INITIAL 

CLR 

A 


11 

AA 

MOV 

R2; 

.A 

12 

AB 

MOV 

R3j 

,A 

13 

AC 

MOV 

R4j 

.A 

14 

AD 

MOV 

R5j 

.A 

15 

AE 

MOV 

R6j 

,A 

16 

AF 

MOV 

R7; 

.A 

17 

04 

JMP 



18 

20 

START 



JUMP TO INITIALIZE - CLEAR 
REGISTERS. 

JUMP TO INTERRUPT SERVICE - 
STOP TIMER. 


TIMER OVERFLOW-OUT OF RANGE 
BEGIN AGAIN. 


CLFAR REGISTERS 
R2= COUNT INTLGER 
R3--C0UNT DECIMAL 
R4-OUT INTI GER. 

RU-OUT DECIMAL 

R6- (COUNT (.1 >-OUT(I-l ) > INTEGER 
S?7- (COUNT(I)-OUT(I-l ) ) DECIMAL 
BEGIN 
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PAGE 2 

HEWLETT-PACKARD 32201A.7nO 

EDlT/3000 TUE, JUN 1> 1982, 1:4 

58 




59 




60 

20 27 START 

CLK A 

CLEAR ACCUMULATOR 

61 

21 62 

MOy T,A 

SET TIMER TO ZERO 

62 

22 04 

JMP ■ 

JUMP TO DISPLAY OUTPUT- WHIL E 

63 

23 AO 

SI-I(3W 

W A I T ]. M C F 0 R T !< A N S M 1 T STAR T 

64 

24 55 TIME 

STRT T 

START TIMER 

65 

25 05 

EM 1 

ENABLE IMTERRU'^T TO STOP TIMER 

66 

26 C5 

SEL RBO 

ON ECHO RETURN 

67 

27 04 

JMP 

JUMP TO CALCULATE NEW RANGE 

68 

28 80 

DISPLAY . 

COUNT DISPLAY 

69 




70 




71 




72 




73 

30 65 STOP 

STOP TCNT 

STOP TIMER 

74 

31 15 

DIS I 

. PREVENT |■•AL.SE ECHOS 

75 

32 C5 

SEL RBO 


76 

33 42 

MOV A;.T 


. 77 

34 AA 

MOM R2,A 

R2=-COUNT(I) 

78 

35 03 

ADD A,=!!-26 

CHECK COUNT LIMIT >90 

79 

36 26 



80 

37 !-2 

JB7 

IF COUNT > 90 SET LIMIT 

81 • 

38 3B 

LIMIT 


82 

39 04 

JMP 

IF NOT, FILTER 

83 

3A 3E 

F?uLT£R 


84 

3B 23 LIMIT 

MOy A,«5A 

SET COUNT -90 

85 

3C 5A 



86 

3D AA 

MOy R2,A 


87 

3E FB FILTER 

MOy A,R3 

R 3 D f; c ;i: m a ! . c o u n t o o h 

88 

3F 37 

CPL A 


89 

40 6D 

ADD A,R5 

R5=-DEC1MAL OUT(I-l ) 

90 

41 37 

CPL A 


91 

42 AF 

MOy R7.A 

R 7 ^ D E C ;i; M A L ( C 0 U N T’ < I > - 0 U T (1 - 1) ) 

92 

43 FA 

MOy A,R2 

R2'-:!NTFGEK COUNT (I) 

93 

44 37 

CPL A 


94 

45 7C 

ADDC A,R4 

R4=-INTI.:CFR OUTd -1 ) 

95 

46 37 

CPL A 


96 

47 AE 

MOy R6>A 

r6=--:i;nteger ( count ( i ) - out < i-i ) ) 

97 

48 85 

CLR FO 


98 

49 B8 

MOy R0,*02 


99 

4A 02 



100 

4B E6 

JNC 


101 

4C 4E 

SHIFT 


102 

4D 95 

CPL i O 

SET FO WHEN ( COUNT (1 ) -OUT (1-1 ) K 


103 

10 ^ 

105 

106 

107 

108 
109 

no 

111 

112 

113 

114 
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115 





116 





117 





118 




■ 

119 

4E 

97 

SHIFT - 

CLR C. 

120 

4F 

EE 


MOV A,R6 

121 

50 

67 


RRA C 

122 

51 

AE 


MOV R6,A 

123 

52 

FF 


MOV A,R7 

124 

S3 

67 


RRA C 

125 

54 

AF 


MOV R7,A 

126 

55 

E8 


DJNZ RO 

127 

56 

4E 


SHIFT 

128 

57 

B6 


JFO 

129 

58 

5B 


SUB 

130 

59 

04 


JMP 

131 

5A 

5F 


ADD 

132 

5B 

FE 

SUB 

MOV A,R6 

133 

5C 

43 


ORL A,il=C0 

134 

5D 

CO 



135 

5E 

AE 


MOV R6,A 

136 

5F 

FD 

ADD 

MOV ,R5 

137 

60 

6F 


ADD A,R7 

138 

61 

AD 


MOV R5,A 

139 

62 

FC 


MOV A,R4 

140 

63 

7E 


ADDC A,R6 

141 

64 

AC 


MOV R4,A 

142 

65 

E3 


M0VP3 A,@A 

143 

66 

39 


OUTL PI, A 

144 

67 

04 


JMP 

145 

68 

20 


START 

146 





147 





148 





149 





130 





151 





152 

SO 

FA 

DISPLAY 

MOV A,R2 

153 

31 

D5 


BEL RBI 

154 

82 

A8 


MOV R0,0 

155 

83 

BF 


MOV R7,440 

156 

84 

40 



157 

85 

BE 


MOV R6,420 

158 

86 

20 



159 

87 

BD 


MOV R5,tl0 

160 

88 

10 



161 

89 

BC 


MOV R4,!|:9C 

162 

8A 

9C 



163 

8B 

BB 


MOV R3,iF6 

164 

8C 

F6 



165 





166 





167 





163 





169 





170 





171 






0 EDn/3000 TUE, JUN 1, 1982, 


DIVIDE <COUNT<I>-OUT(I-l > ) BY 
A WITH 2 RIGHT SHIFTS 


ADJUST INTEGER PART IF DIFFERENCE 

NEGATIVE 

OTHERWISE ADD 

INTEGER ADJUST 


COMPLETE FILTER ADDITION 
OUTa)-OUT(I-l) + 0.2Ux(COUNTa)- 
OUT(I-l) ) 

STANDARD FIRST ORDER FILTER 
WITH TF=TS 

FIND FOCUS COMMAND 
OUTPUT COMMAND 
DO IT AGAIN 


PUT COUNT(I) INTO ACCUMULATOR 
WORK IN REGISTER BANK 1 
R0=- REMAINDER STORAGE 
R7“ HUNDREDS OUTPUT/CONTROL 
40H=CONTROL 

R6:^ TENS OUTPUT/CONTROL. 
20H=^CONTROI. 

R5-UNITS OUTPUT/CONTROL 
10H=CONTROL 

R4 N-iUNDREDS SUBTRACTOR 
R3=^TENS SUBTRACTOR 
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172 

173 

174 

175 

176 

177 

178 

179 

180 
181 

8D 

6C 

HUNDRED 

ADD A,R4 

182 

8E 

E6 


JNC 

183 

8F 

94 


TENS 

134 

90 

AB 


MOV R0,A 

185 

91 

IF 


INC R7 

186 

92 

04 


JMP 

187 

93 

8D 


HUNDREDS 

188 

94 

F8 

TENS 

NON A,R0 

189 

95 

6B 


ADD A,R3 

190 

96 

E6 


JNC 

191 

97 

9C 


UNITS 

192 

98 

AB 


LOU R0,A 

193 

99 

IE 


INC R6 

194 

9 A 

0 4 


JMP 

195 

9B 

94 


TENS 

196 

9C 

FD 

UNITS 

LOU A,R5 

197 

9D 

68 


ADD A,R0 

198 

9E 

AD 


LOU R5,A 

199 

9E 

00 


NOP 

200 

201 

202 

203 

204 

205 

AO 

D5 

SHOW 

SEL RBI 

20 6 

A1 

FF 


LOU A,R7 

207 

A2 

3A 


GUTL P2,A 

20 8 

A3 

14 


CALL 

209 

A4 

BO 


DELAY 

21 0 

A 5 

FE 


MOU A,R6 

211 

A 6 

3A 


DUTL P2,A 

212 

A 7 

14 


CALL 

213 

A8 

BO 


DELAY 

214 

A 9 

FD 


MOU A,R5 

215 

AA 

3A 


GUTL P2,A 

216 

AB 

14 


CALL 

217 

AC 

BO 


DELAY 

218 

AD 

04 


JMP 

219 

AE 

AO 


SHOW 

220 

221 

222 

223 

224 

225 

226 

on 

27 

DELAY 

CLR A 

227 

B1 

17 

X 

INC A 

228 

B2 

36 


JTO 


SUBTRACT 100 PROM COUNT, •IN- 
CREMENT HUNDREDS COUNTER IF 
SUBTRACTION SUCCSSf- UL . CON- 
TINUE. OTHLRWISE GO TO TENS. 


SAME AS BEFORE EXCEPT FOR 
TENS . 


REMAINDER IS UNITS, ADD TO 
RU . 


SELECT REGISTER BANK 1 WITH 
D;iSPEAY DATA AND CONTROE 
OUTPUT HUNDREDS 


OUTPUT TENS 


OUTI'UT UNITS 


DO IT AGAIN 


DISPLAY DiiGJT 

IE TO HIGH, STAR !'. T3 HER 
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29 ' B3 24 

30 B4 96 

31 B5 B1 

32 B6 93 


TIME 

JNZ 

X 

RETR 


OTHERWISE, CONTINUE THE 
DISPLAY 
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1 

300 

00 RANGE 

RANGE/COUNT DATA FOCUS CONTROL DATA AT COUNT 

2 

1 


ADDRESS, PAGE 3 OF MI-.MORY., 

3 

Y 


... 

A 

321 

00 


5 

322 

ID 

lS.5"/34 . 

6 

323 

3A 

19.0V35 - — - 

7 

324 

3F 


8 

325 

46 

20,0‘V37 

9 

326 

4A 


10 

327 

4F 

21.0V39 

11 

328 

54 


12 

329 

SA 

22.0V41 

13 

32A 

5C 


14 

32B 

62 

23. 0 V43 

15 

32C 

6 A 

24.0'V44 

16 

321) 

6C 


17 

32F. 

70 

25.0 "/46 

18 

32F 

74 


19 

33 0 

78 

26.0V48 

20 

331 

79 


21 

332 

7B 

27. 0 V50 

22 

333 

7D 


23 

334 

80 

28. 0"/52 

24 

. 335 

83 

29.0V53 

25 

336 

86 


26 

337 

89 

30.0"/55 

27 

338 

8A 


28 

339 

8C 

31.0 V57 

29 

33 A 

8D 


30 

338 

8F 

32. 0V59 

31 

33C 

91 


32 

33D 

93 

33. 0V61 

33 

33E 

95 


34 

331" 

98 

34 . 0 "/63 

35 

340 

9A 

35.0'V64 

36 

341 

9B 


37 

34 2. 

9C 

36. 0V66 

38 

3 43 

9E 


39 

344 

AO 

37. 0V68 

40 

345 

A1 


41 

346 

A2 

3B.0V7O 

42 

347 

A3 


43 

348 

A4 

39.0V72 

44 

349 

A5 

40 .0-/73 

45 

34A 

A6 


46 

34B 

A7 

41.0-/75 

47 

34C 

A8 


48 

34D 

A 9 

42.0-/77 

49 

34E 

AA 


50 

341- 

AB 

43.0-/79 

51 

350 

AC 


52 

331 

AD 

44 . 0 "/81 

53 

352 

AE 


54 

353 

AF 

45.0-/B3 

55 

354 

BO 


56 

355 

B1 

46 . 0 "/85 

57 

356 

BE 

47.0-/86 
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58 

357 

B3 

59 

358 

B4 

60 

359 

B4 

61 

35A 

B5 

62 

35B 

B5 

63 

35C 

B6 

64 

35D 

B6 

65 

35E 

B7 

66 

35F 

B7 

67 

360 

00 

68 

{ 


69 

T 


70 

380 

00 

71 






3 . TRACKING CONTROL 


One of the major improvements which could be made in 
the present oculometer system is a better search routine. 
This task now takes valuable time from data acquisition. 

When the subject's eye image is lost, the software 
drops into a locate and verify process. To accomplish 
this, the mirror control unit is directed to search in a 
small area by scanning in the X direction, the increment- 
ing in Y and repeating the X scan. If the small search 
area is not fruitful, a larger area is searched. This 
process if repeated (X-Y scan) until an eye image with 
round pupil and corneal highlight is obtained. It is 
then verified and only then can valid look point data be 
collected. The search process is not always successful. 
When this happens, large blocks of time are used in 
repetitously repeating the same X-Y scan pattern. 

If the eye and/or head moves slightly, so that the 
image stays in the picture, minor adjustment in the mirror 
position are made by the software. These attempt to 
keep the pupil center in the TV picture. This segment of 
the oculometer 's operation works well. 
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The purpose of the unit developed for head tracking 
is to supplement the oculometer when a search is necessary. 
It does not replace the fine adjustments made when the 
eye is centered. The unit will basically tell the computer 
where the head is located and direct the mirrors to that 
location by using X-Y ultrasonic ranging systems. By 
employing a known offset, the- eye can be found. The geo- 
metry of the system's operation is shown in figure 14. 

3.1 SYSTEM OVERVIEW 

HARDWARE ; Refer to figures 14 and 15. The overall 
system operation originates at the rate controller which 
alternately switches between the X and Y ultrasonic systems. 
The ultrasonic system is the same (7) as used in the auto- 
matic focusing unit. Both the X and Y ultrasonic boards 
are buffered to give compatible signals to the wave-shaping 
circuit and microprocessor. 

The only difference between the focusing unit ' s ultra- 
sonic operation and the head tracking system is the X-Y 
rate controller. Its signal, a 200 msec, square wave, 
is fed into the microprocessor as well as the ultrasonic 
units. When high, a Y distance, measurement is being 
made. A low level indicates that the X direction is being 
measured. Thus, once every 200 msec., the X transmitter 
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ULTRASONIC MICROPHONE 


J 



ULTRASONIC 

MICROPHONE 


Y 



MIRROR 

ANGLES 


X = measured distance 
X = fixed offset 

y = measured distance 
Y = fixed offset 


FIGURE 14. Tracking system geometry. 





MANUAL 

CONTROL 


FIGURE 15. Automatic Tracking System 
block diagram. 
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is turned on for about 1 msec.; the receiver then waits 
for an echo for 100 msec. The X unit is then turned off 
and the same operation repeated for Y. 

Three signals, START of transmission, ECHO received, 
and X-y Direction indicator are fed into the microcomputer. 
This information is processed and outputted on Port 1 
for X and Port 2 for Y. The 8 bit output signals are 
converted to analog form by two DAC's. 

The analog signal is nov; fed to a power amplifier 
which converts the voltage input to a current output. 

Where in turn it drives two orthogonal galvanometer motors. 
The mirrors, motors, and their housing were also sup- 
plied by NASA. This last link in the system directs the 
IR beam to the target. 

There is a provision to manually control the mirrors 
with a "joy stick." Voltage for the joy stick is from a 
+1.25V regulated supply. Also, the system can be manually 
reset. 

SOFTWARE ; Figure 16 gives the flow chart for the 
software programmed into the EPROM memory of the microcomputer 

After a manual RESET, the program jumps to INITIALIZE 
where registers are cleared and the X-Y offset loaded. 

Note that for different mirror-microphone relationships, 
these values would have to be changed, see figure 14. 
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) 



( A 


FIGURE 16. Automatic Tracking System 
flow chart. ' 


) 
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The particular offset presently loaded is for 19" in the Y 
direction and 27" in the X direction. 

The program now jumps to START where the target 
range is next stored. This is also fixed in the demonstra- 
tion unit at 36", but could be constantly updated by the 
automatic focusing unit if the same microcomputer con- 
trolled all functions (see Conclusions) . The Timer is 
cleared and the system put into an idle mode until TJ^ 
goes high. T0 corresponds to the START of the ultrasonic 
transmission. The Timer is started and, while waiting 
for the ECHO, and X-Y flag is set to indicate which di- 
rection is being measured. The flag is controlled by T1 
which is reading the high-low status of the ultrasonic 
rate controller. 

When the INTERrupt goes low, meaning that an ECHO 
has been received, the Timer is STOPped and the distance 
count stored. 

The DIFFerence between the offset X/Y and the mea- 
sured distance x/y is next calculated. A flag F0 is set 
for a negative result. 

To find the angle, 9, which controls the mirrors 
movement, the DIVIDE routine is used (9) . The approximation 
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) 

is used in this algorithm since the angles will be less 
than + 14°. For the particular application 

0 = (X - x) /Range 

0,^ = (Y - y) /Range 



The output of this computation is in a sign(Fff) -magni- 
tude format. To correctly operate the digital to analog con- 
verter, an offset binary is required. The transformation 
^ between the two is provided by CONVERT (and a potentiometer 

setting) . 

The program next drops down to OUTPUT which latches 
the command 6 into Ports 1 or 2 if the measurement was X or 
Y respectively. The program then branches back to START and 
recycles through the entire operation. 

Should there be a Timer overflow due to the lack of 
a target (no ECHO), the program will also return to the START 
routine to continue its cycle. 

3.2 ELECTRONIC CIRCUIT 

The electronic circuit diagrams for the head tracking 
system are shown in figures 17 through 22. 

) 
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Figure 17 is the X ultrasonic unit. It is mounted 
so as to measure target motion in the X direction only. 

It consists of an ultrasonic ranging system board with 
a capacitive microphone and a buffer circuit as shown. 

This is a speed up circuit which allows pulsing at a 50 
msec rate. Note that the START and ECHO signals swing 
between 0 to 5 volts. These are fed to the wave shaping 
network. Also included in the X ultrasonic unit is the 
multivibrator rate controller for alternating X and Y 
measurements. This made from a 74C14 and a simple RC 
timer. The X^ signal likewise controls the Y unit and 
is. used as an input to the microprocessor. 

Figure 18 is the ultrasonic Y unit and is identical 
to the X unit except that no rate controller is present. 

In figure 19 the START and ECHO signals from X and Y 
are fed into NOR gates which output 'a pulse when trans- 
mission starts and an echo is received. The pulses are used 
to trigger the 74123 's dual monostables.. The first monostables 
in each 74123 is set to about 10 msec. The second, driven 
by the first, gives only a 20 usee pulse which drives the 
microprocessor. ■ The first monostable time is long in order 
to isolate the microprocessor from noise and false echos 
(from multiple targets) . The START signal triggers the T0 
pin and the ECHO signal triggers the INT pin. A 6MHz crystal 
controls the speed of operation of the processor and the timer. 
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FIGURE 18. Y ultrasonic board with buffer 








V 





The RESET switch discharges the capacitor through a IK to 
force the reset pin low. The Tl input is from which signals 
the processor as to which direction, X or Y, is being measured. 
The output Port 1 is to the X mirror control, while Port 2, 
divided into two 4 bit nibbles, controls the Y mirror. 

In figure 20 the outputs from the 8748 drive two 1408 
DAC's that are set up for bipolar operation. The. 8 bit input 
is converted to a 0 to -2mA output. This is combined with 
currents from a 5 volt source through a 22K and lOK pot. 
One-half a 4558 op-amp is used for each direction to convert 
the current to an output voltage. The 22K-10K pot parallel 
combination allows adjustment to the reference position in a 
manner similar to that provided by the X-Y offset value. 

Figure 21 shows the regulated voltage source for the 
manual joy stick control. It is composed of an LM317 (posi- 
tive voltage) and LM337 (negative voltage) adjustable voltage 
regulators. The input to the circuit is +15V, its output 
+1.25V. A switch allows selection between manual and auto- 
matic control. The X . is connected to the driver 

out out 

amplifiers. 

Finally figure 22 gives the pin connections for the 
interconnecting cables. The first, a 10 conductor ribbon 
cable, is for the X-Y START /ECHO signals, the direction signal, 
and a 5V source. The other cable carries the 6V for the ultra- 


sonic boards. 



IS8 1 2, 



FIGURE 20. DAG output (1408 - 4558) 








8 PIN PLUG 


1 

BLACK 

5V gd. 

2 

WHITE 

+ 5V 

3 

GRAY 

Y ECHO 

4 

PURPLE 

Y START 

5 

BLUE 

x/y MEASUREMENT 

6 

BROWN 

X ECHO 

7 

RED 

X START 


4 PIN PLUG 

2 BLACK 6V gd. 

4 BLACK +6V 


FIGURE 22. Cable connections for 

Automatic Tracking System. 



3 . 3 SOFTWARE 


The program memory as shown in figure 23 is divided 
into various routines which correspond to those shown in 
the flow chart, figure 16. The entire program takes up less 
than 1 page of memory and can even be condensed further if 
all the routines were compacted one directly behind the 
other. 

The on-board registers are used as indicated in fig- 
ure 23. In register bank 0, RB0 , register R0 is the flag 
which points to X or Y data as determined by the signal. 

Rl points to the divisor for the divide routine. This is 
R7 in the demonstration unit. R7 contains the range in- 
formation. Rl also points to the X or Y offset (R34 or R35) 
during the DIFF routine. R2 is the dividend and R3 a 
counter for the DIVIDE routine. R3 is also a temporary 
storage location during OUTPUT. 

R32 and R33 store the most recent X and y measured 
distances respectively. R34 and R35, the X and Y fixed 
offset^ must be altered if the relationship between the mirrors 
and the ultrasonic, microphones is changed. 

The remainder of this section is the actual program 
stored in the EPROM of the 8748. Comment statements describe 
its operation. The format is the same for the automatic focus 
control unit Software discussion. 
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RB0 page 


MEMORY MAP 


PROGRAM MEMORY 



REGISTERS 

0H 

x/y POINTER 

IH 

DIVISOR POINTER/X,Y OFFSET 1 

2H 

DIVIDEND i 

3H 

COUNTER/OUTPUT STORAGE : 

7H 

RANGE COUNT 1 


V77/7777/7//V-/: 

32H 

X COUNT 

33H 

y COUNT 

34H 

X OFFSET 

35H 

Y OFFSET 



FIGURE 23. Automatic Tracking System 
memory map. 
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MIRROR CONTROL PROGRAM FOR OCULOMETER 
AUTOMATIC HEAD TRACKING USING INTt'L 8748 
4-30-32, WJG 

FORMAT-ADDRESS/DATA OR INSTRUCTION/LABEL/MNE MONIC/COMMFNT 


X- -X- X X X- X X X X X X X X -X X X X X X X X X X -X X X X X X X X -X X X X X X X X X X X X X X X X X -X X X X X X X X X X 

LOCATION 00-08 USED FOR RESET, INTERRUPT, AND TIMER OVERFLOW 
VECTORS. 


00 

0 4 

RESET 

JMP ■ 

JUMP 

TO INITIALIZE 

01 

10 


INITIALIZE 



02 

00 





03 

04 

INTER 

JMP 

JUMP 

TO INTERRUPT SERVICE 

04 

60 


STOP 

STOP 

TIMER 

05 

00 





06 

00 





07 

04 

TOVER . 

JMP 

JUMP 

TO START - TIMER OVER!- LOW 

08 

30 


START 

OUT 

OF RANGE. 


10 

27 INIT 

CLR 

A 

CLEAR 

ACCUMULATOR 

11 

A9 

MOV 

R1,A 

CLEAR 

REGISTERS R1 TO R7 

12 

AA 

MOV 

R2,A 



13 

AB 

MOV 

R3,A 



14 

AC 

MOV 

R4 ,A 



15 

AD 

MOV 

R5,A 



16 

AE 

MOV 

R6,A 



17 

AF 

MOV 

R7,A 



18 

B8 

MOV 

R0,l!34 

RO IS 

POINTER TO R34 

19 

34 





lA 

BO 

MOV 

@R0,^32 

32 TO 

R34 (X 0FFS!;.T=27") 

IB 

32 





1C 

18 

INC 

RO 

R0=-35 


ID 

BO 

MOV 

6R 0,^23 

23 TO 

R35 (Y 0FFSET=19") 

IE 

23 





IF 

04 

JMP 




20 

30 

START 
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53 

59 

60 

61 ' 

62 


63 






64 






65 






66 






67 

30 

BF 

START 

MOO R7,*42 R7---RANGE COUNT, SET AT 36" 

68 

31 

42 




69 

32 

27 

TIMSTRT 

CLR A 

CLEAR ACCUMULATOR 

70 

33 

62 


MOU T,A 

SET TIMER TO ZERO 

71 

34 

26 

IDLE 

INTO 

IDLE UNTIL TO HIGH 

72 

35 

34 




73 

36 

55 


STRT T 

START TIMER 

74 

37 

00 


NOP 


75 

38 

56 


JTl 

SET X/Y FLAG 

76 

39 

3E 


YFLG 


77 

3A 

B8 

XFLG 

MOO R0,i!3c 

! X MEASUREMENT,. R0“32 

78 

3B 

32 




79 

3C 

04 


JMP 

JUMP TO INTERRUPT WAIT 

80 

3D 

50 


WAIT 


81 

3E 

B8 

YFLG 

MOV R0,t33 Y MEASUREMENT, R 0:^33 

82 

3F 

33 




83 

40 

04 


JMP . 


84 

41 

50 


WAIT 


85 






86 






87 






88 

50 

86 

WAIT 

JNI 

WAIT HERE- FOR INTERRUPT 

89 

51 

60 


STOP 


90 

52 

04 


JMP 

- 

91 

53 

50 


WAIT 


92 






93 






94 






95 






96 






97- 

60 

65 

STOP 

STOP TCNT 

STOP TIMER 

98 

61 

00 


NOP 


99 . 

62 

00 


NOP 


00 

63 

42 

• 

MOV A,T 

MOVE COUNT TO ACCUMULATOR 

01 

64 

AO 


MOV SR0,A 

STORE- X/Y COUNT IN R32/R33 

.02 

65 

04 


JMP 

JUMP TO DIFFERENCE 

03 

66 

70 


DIFF 



1 04 
1 05 
1 06 
107 
1 03 
1 09 

no 
1 1 1 
112 

113 

114 
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1 15 

70 

F8 

DIFF 

MOV A,R0 

MOVES X/Y POINTER TO ACCUMULATOR 

116 

71 

17 


INC A 

POINTS TO- X/Y OEFSET REGISTER 
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4. CONCLUSIONS 


Both projects, automatic focusing and head tracking, 
have proved the feasibility of such an approach to the im- 
provement of the oculometer- system. Major tasks still 
exist if the schemes herein reported are to be successfully 
incorporated into the Langley oculometer. 

First the ultrasonic boards should be redesigned for 
this specific application. The present system produces 
audible "clicks" as it turns on, can operate only at limited 
rates, and has a narrow ultrasonic beam. These problems 
could be eliminated with a custom ultrasonic ranging system. 

A scheme to bounce the ultrasonic beam off the mirrors 
and thus have it travel along the same path as the IR beam 
would help the automatic focusing unit. This would insure 
that the range, and hence the focus control, is directed at 
the eye . 

It is possible to incorporate both focusing and track- 
ing systems into a single unit. Thus one 8748 could control 
both operations, thereby reducing the complexity of the 
total . 

There is enough memory to do this, but some major hard- 
ware modifications would be necessary. 
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Integration of these systems with -the oculometer 
should be a paramount consideration. The range data 
and mirror control information can be advantageously 
used by the minicomputer. It may even be possible to do 
some preprocessing of these signals to further unburden 
the minicomputer. 

Finally, a simple initialization routine should be 
developed so different sites can easily be set up. This 
could be incorporated through minicomputer control or by 
the manual provisions contained on the focusing and track- 
ing units. 
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